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Abstract 



One of the key performance measures in queueing systems is the exponential 
decay rate of the steady-state tail probabilities of the queue lengths. It is known 
that if a corresponding fluid model is stable and the stochastic primitives have 
finite moments, then the queue lengths also have finite moments, so that the tail 
probability P(- > s) decays faster than s~ n for any n. It is natural to conjecture 
that the decay rate is in fact exponential. 

In this paper an example is constructed to demonstrate that this conjecture 
is false. For a specific stationary policy applied to a network with exponentially 
distributed interarrival and service times it is shown that the corresponding fluid 
limit model is stable, but the tail probability for the buffer length decays slower 
than s" logs . 

1 Introduction. 

A key performance measures in queueing models is the decay rate of the queue length 
distribution in steady state [9J, El El [13] . Except in trivial cases, the decay rate is at 
best exponential for networks with a finite number of servers. Moreover, an exponen- 
tial decay rate can be verified in many queueing models either by direct probabilistic 
arguments such as Kingman's classical bound for the G/G/l queueing system, using 
Lyapunov function type arguments [151 El H] ( see m particular Sections 16.3 and 16.4 
of [IS]), using large deviations techniques [19], and even specialized techniques based 
on a fluid limit model [HI Theorem 4] . 
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Figure 1: Rybko-Stolyar network 



Except in special cases, such as single-class queueing networks [7j, verifying the 
existence of an exponential tail is non-trivial precisely because verifying stability of a 
multi-class network is no longer straightforward. It is now well known that the standard 
load condition p, < 1 is not sufficient for stability. This was demonstrated in the two 
seminal papers of Kumar and Seidman [10] and Rybko and Stolyar [IB] , based on the 
network depicted in Figure [TJ henceforth called the KSRS network. 

Motivated in part by these examples, over the past ten years new methods have 
been developed to verify stability. The most general techniques are based on the 
fluid limit model (recalled below equation (jS])) starting with the work of Malysev and 
Men'sikov [12] and Stolyar [20]. This was extended to a broad class of multiclass 
networks by Dai [2]. 

Dai showed that stability of the fluid limit model together with some mild condi- 
tions on the network implies positive Harris recurrence for a Markovian state process, 
which implies in particular the existence of a unique steady state for the underlying 
queueing network. This result was extended in Dai and Meyn [3] where it is shown 
that the queue lengths have finite moments in steady state up to order p if the stochas- 
tic primitives of the network (interarrival and service time distributions) have finite 
moments up to p + 1. 

As a direct implication of the main result of [3], if the stochastic primitives have 
an exponential moment, and if the fluid limit model is stable, then the decay rate of 
the queue length distribution in steady state is faster than than any polynomial, in the 
sense that, for any p > 1, 

(1) limr(s)P{||Q(0)|| >s} = 0, 

s— »oo 

where r(s) = s p , and the probability is with respect to a stationary version of the 
queue. 

It is then natural to conjecture that an exponential bound holds, so that (OQ) holds 
with r(s) = e ds for some 9 > 0, provided the stochastic primitives possess exponentially 
decaying tails. The purpose of this paper is to construct a particular stationary policy 
and a particular network to demonstrate that this conclusion in fact does not hold. 
Moreover, a polynomial rate is about the best that can be attained: In the example it is 
found that ([I]) cannot hold for any sequence {r(s)} satisfying lim inf^^ r(s) / s log ^ > 0. 
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The example is a particular instance of the KSRS model in which the interarrival 
and service times have exponential distributions. The scheduling policy is stationary, 
and the corresponding fluid limit model is stable, yet the queue length process has 
heavy tails in steady-state. The policy is based on carefully randomizing between a 
stable policy, and the unstable policy introduced by Rybko and Stolyar. 

The remainder of the paper is organized as follows. In the following section we 
describe the model and the main result. In Section [3] we present a short proof of 
the earlier result of |3J in the special setting of this paper. The construction of the 
counterexample is provided in Section HI The details of the proof of the main result 
are contained in Sections [5] and [6j Some technical arguments are placed in an appendix. 

We close the introduction with some notational conventions: The iih unit vector 
in R N is denoted for 1 < i < N. The Li-norm, always denoted || ■ ||, is defined by 
||a|| = J2i<i<N l a «l f° r a e ^ N ■ Given two positive real valued functions f(x),g(x), the 
notation / = 0(g) stands for f(x) < Cg(x) for some constant C > and all x > 0. 
Similarly, f = Q(g) means f(x) > Cg(x) for all x > and / = 0(g) means f = 0(g) 
and f = Q(g) at the same time. Given a Markov chain or a Markov process Z defined 
on a space Z and given a probability measure v on Z, we let F u (Z(t)) denote the law of 
Z(t) initialized by have Z(0) distributed according to v. Specifically, for every x E Z, 
F x (Z(t)) is the law of Z(t) conditioned on Z(0) = x. The notations E„[-], E^-] have 
similar meaning corresponding to the expectation operator. 

2 Model description and main result 

The model and the definitions of this paper follow closely those of [3]. We consider a 
multiclass queueing network consisting of J servers denoted simply by 1, 2, . . . , J. Each 
customer class is associated with an exogenous arrival process which is assumed to be a 
renewal process with rate Aj. Here N denotes the number of classes. It is possible that 
Aj = for some of the classes, namely, no external arrival is associated with this class. 
We let A = (Aj), 1 < i < N. Each server is unit speed and can serve customers from 
a fixed set of customer classes i — 1, 2, . . . , N. The classes are associated with servers 
using the constituency matrix C, where G%j = 1 if class i is served by server j, and 
Cij = otherwise. It is assumed that each class is served by exactly one server, but the 
same server can be associated with many classes. Each class is associated with a buffer 
at which the jobs are queued waiting for service. The queue length corresponding to 
the jobs in buffer i at time t is denoted by Qi(t), and Q(t) denotes the corresponding 
iV-dimensional buffer. 

It is assumed that routing is deterministic: The routing matrix R has entries equal 
to zero or one. Upon service completion, a job in class % proceeds to buffer i + , where 
i + denotes the index satisfying R ii+ = 1, provided such an index exist. In this case 
buffer i is called an internal buffer. If no such index exists, then this is an exit buffer, 
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and the completed job leaves the network. The network is assumed to be open, so that 
R N = 0. 

For the purpose of building a counterexample we restrict to a Markovian model: 
The arrival processes are assumed Poisson, and the service times have exponential 
distributions. It is also convenient to relax the assumptions above and allow infinite 
rates for service at certain queues. That is, the corresponding service time is zero. For 
this reason it is necessary to show that the main result of [3] can be extended to this 
setting. 

We can express the evolution of the queue length process as 

N 

Q(t) = Q(0) + + Rij]Di(t) + Mt) 

v I i,j=l 

= Q(0) + [-/ + R T ]D(t) + A(t), 

where Aj is the cumulative arrival process to buffer i, and Di is the cumulative depar- 
ture process from buffer i. The second equation is in vector form with R equal to the 
routing matrix, and D(t),A(t) the ^-dimensional vectors of departures and arrivals. 
If the service rate /ij is finite, then the departure process can be expressed, 

Di(t) = Si(Zi(t)), z = l,...,JV, t>0, 

where Si is a Poisson process with rate /ij, and Zi(t) is the cumulative busy time at 
buffer i. All of these processes are assumed right continuous. 

The following assumptions are imposed on the policy that determines Z: It is 
assumed throughout the paper that the policy is stationary. In this setting, for buffers 
with finite service rate this means that 4:Zi(t) is piecewise constant, and when the 
derivative exists it can be expressed as a fixed function of the queue-length process, 
4:Zi(t) = (fii(Q(t)). Moreover, for each i satisfying /ij = oo there is a fixed set of values 
Sj C such that the contents of buffer i are drained at the instant Q(t) G Ej. 

We also considered randomized stationary policies. In this case fa is a randomized 
function of Q(t), and the draining of a buffer with infinite service rate occurs with some 
probability depending upon the particular value of Q(t) G Sj observed at time t. 

It is assumed that the policy is non-idling: For each station we have ^Zi(t) = 1 
when Qi{t) > 0) where the sum is over i at the given station. 

Throughout much of the paper we restrict to the KSRS model in which the routing 
and constituency matrix are expressed, 

"0 0' 
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The network is symmetric: The two non-null arrival processes are independent Poisson 
processes with rates A 2 = A 4 > 0, and the service rates at buffers 2 and 4 are finite 
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and equal, \i2 = fi4 < oo. The service rates at buffers 1 and 3 are infinite. Hence, for 
example, if at any moment priority is given to buffer 1, then all of the contents pass 
instantly to buffer 2. 

The transition semigroup for Q is denoted, 

P\x, A) = ¥{Q(t) G A | Q(0) = x}, x G Z™ , t > 0, A c Zj, 

and F x ( ■ ) the probability law corresponding to the initial state Q(0) = x. A probability 
measure n on the state space is invariant if Q is a stationary process when initialized 
using Ti. This is equivalently expressed by the invariance equations, 

7r(y)=5>(x)P*(x,y), y G Zj, t > 0. 
We say that n has an exponential tail if for some # > 0, 

X 

The Markov process is called exponentially ergodic if 7r exists, and for some 9 > and 
each x, y, 

(3) lime e *|P :c (Q(t)= 2 /)-7r( 2/ )| = 0. 

f — >oo 

Exponential ergodicity implies an exponential tail. The proof of Proposition 12.11 is 
provided in Section [3j 

Proposition 2.1. Consider the network in which fii < oo for each exit buffer. 
Assume that the network is controlled using a stationary policy. If Q is exponentially 
ergodic, then it has an exponential tail. 

We now construct the fluid limit model associated with the network ([2]). To empha- 
size the dependence on the initial state Q(0) = x we denote the queue and allocation 
trajectories by Q(-, ). The scaled initial condition is defined for k > by, 

(4) x k :=-[kx\, iGif, 

K 

and the scaled processes are defined for t > via, 

(5) q K {t]X K ):=-Q(Kt]KX K ), z K (t; x K ) := -ZUt] kx k ). 

K K 

Observe that x K G satisfies kx k G Z^ for each k. For each x G Z^ and u G Vl we 
let C x {uj) denote the set of all possible fluid limits, 
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C x {oj) = | u.o.c. subsequential limits of {q K (t; x K ,u), z K (t; x k ,lj)} j, 

where 'u.o.c.' means that convergence is uniform on compact time intervals as Ki — > oo 
for some subsequence The fluid limit model is the union C := \J xe zn£ x . It is clear 

that any fluid limit must satisfy the fluid model equation, 

(6) q(t) = q(0) + [-1 + R T }z(t) + At, 

in which (z,q) satisfy assumptions analogous to (Z,Q) [2l [T3]. 

The fluid limit model C is said to be stable if there exists Qq C Q satisfying 
Pj^o} = 1) and T > such that q(t) = whenever t > T , uj G flo, q G C(u) and 

ll?(o)|| = i. 

Naturally, the fluid limit model as well as the conditions for stability may depend 
on the scheduling policy. In many cases (such as the G/G/l queue) the set of fluid 
limits C x is a deterministic singleton for each x. 

The following is the key motivating result for our paper. 

Theorem 2.2. Consider the network model (j2J) controlled using a stationary non-idling 
policy. Suppose that /Xj < oo at each exit buffer, and that the fluid limit model is stable. 
Then, 

(i) Q is aperiodic and positive Harris recurrent: There is a unique invariant 
measure it such that the distributions converge in total variation norm for each 
initial condition x G Z+, 

lim(sup \F x (Q(t)=y)-n(y)\)=0. 

(ii) The invariant measure has polynomial moments: For each p > 1, 
(7) 7r ( x )W x W P < °°- 

Theorem 12.21 asserts that the model (J2J) is positive Harris recurrent with polynomial 
moments of order p for every integer p when the interarrival and service times are 
exponentially distributed. This suggests that 7r will have an exponential tail, so that 
E^'IM )!!] < oo for some 9' > 0. We now show that this conjecture does not hold 
true. 

Theorem 4.1 of [3] considers general models with renewal inputs, and also estab- 
lishes rates of convergence to stationarity and other ergodic theorems for the model. In 
Theorem 12.21 we have extracted the part that is most relevant to the counterexample 
described next. 
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Theorem 2.3. Consider the Rybko-Stolyar model described by the Markovian model 
(GJ) as follows, 
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Qi(t) = Qi(0)+Mt)- D i(t)> i = 
Qi(t) = Q i (p)+D i _. 1 (t)-D i (t), % 



1,3 



2,4. 



There exist network parameters and a stationary policy satisfying, 

1. The interarrival and service times are mutually independent with exponential dis- 



2. The fluid limit model is stable (hence there exists a unique invariant measure ix .) 

3. The invariant measure it satisfies 



where *&(s) = s logs for s > 0, and \I/(0) = 0. In particular, the invariant measure 
7i does not have an exponential tail and the Markov process is not exponentially 
ergodic. 

Theorem 12.31 establishes that the result ([7]) of Theorem 12.21 is nearly tight, modulo 
the log term in the exponent. 

The proof of Theorem 12.31 is technical. It is simplified substantially through our 
adoption of a relaxation in which the service rates at buffers 1 and 3 are infinite. The 
resulting process violates the assumptions of Dai and Meyn [3], but we show in the 
following section that these results carry over to this more general setting to yield 
Theorem 12.21 

3 Stability of Markovian networks 

In this section we establish some general properties of the model (121) . In this section 
only we consider the embedded chain obtained via uniformization. It is known that 
geometric ergodicit}Q of this chain is equivalent to exponential ergodicity of the process 



Uniformization must be applied with care when service rates can be infinite. We 
define sampling times {r n , n > 0} corresponding to jumps of a Poisson process derived 
from the arrival-service process {A, S}. This is commonly interpreted as sampling 
at arrival epochs and (real or virtual) service completions. However, in sampling we 
restrict to non-zero length service completions to avoid sampling twice at the same 
instant! 

Right-continuity implies that Q(r n ) = Q{j+) for each n. 
lr Thc definition of g. ergodicity is precisely ([3]) in discrete time. 



tribution. 



(9) 



E^(||Q(0)||)] = oc, 



0. 
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It is in fact simplest to ignore most of the network structure, and consider a general 
Markov chain denoted X on Z+ satisfying a version of the so-called skip-free property 
[T6] along with a standard irreducibility condition. 

The skip-free condition is defined with respect to the L\ norm. Under the as- 
sumption that the service rate at any exit buffer is finite it follows that the increments 
\\X{t + 1)|| - ||X(i)||| are bounded in the network model (J2D when {X(t) := Q(r t ) : 
t G Z + }. Note that the increments of the norm \\X(t + 1) — -X"(t)|| are not bounded in 
a queueing model that allows instantaneous transfer of buffer contents. 

The following result establishes Proposition 12.11 

Theorem 3.1. Suppose that X is a Markov chain on Z^ satisfying the following 

(i) It is skip-free in the sense that for some constant bo and every initial condi- 
tion, 

(10) -b < ||X(i+l)|| - \\X(t)\\ <b , t>0. 

(ii) The chain is -irreducible, in the sense that 

(11) ^P*(x,0) > for eachx. 

t 

(iii) X is geometrically ergodic 
Then n has an exponential tail. 

Proof. The proof proceeds in two steps. 

Denote the moment generating function by h$(x) = K x [e °], 9 > 0, x G Z™, where 
To is the first hitting time to the origin. Theorem 15.2.4 and Theorem 16.3.2 of [16] 
imply that 7r(h$) < oo for sufficiently small 9 > 0. 

The second step is to compare hg with the function gg(x) = e " 21 ", 9 > 0, x £ 7f[. 
The skip-free assumption implies the bound, 

(12) |||X(t)||-||X(0)||| <b t, t>0, 

so that To > fro 1 !! 3 -!! w hh probability one when X(0) = x. Hence gg/b (x) < hg(x) for 
all x. We conclude that, 

E ^ e W6o)||x(o)||] = J2n(x)g e/b0 (x) < 5>(x)/*(x) < oo. 

□ 

The definition of the fluid limit model is defined for any Markov chain exactly as 
in the network model via (jSJ). 
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Theorem 3.2. Suppose that X is a Markov chain on satisfying (i) and (ii) of 
Theorem \3.1[ Suppose moreover that the fluid limit model is stable, in the sense that 
for some T > and a set Qq C Q satisfying F{Q Q } = 1, 

lim -\\X(kP, kx k )\\ = 0, < 1, t > T , u e Q - 

Then X is positive Harris recurrent, and its unique invariant measure it satisfies 
n ( x )\\ x \\ p < 00 f or eac h p > 1. 

Proof. In Proposition 13 .31 we establish a Lyapunov drift condition of the form: For each 
p > 1 we can find a function V and positive constants b and e such that, 

(13) PV (x) = E[V(X(t + 1)) I X(t) = x}< V(x) - eV l -\x) + b , 



where 8 = (1 +p) 1 - Moreoever, the function V is equivalent to 

/ V(x)\ f V(x)\ 

(14) < liminf inf — ^-f - ) < lim sup ( sup — ) < °°- 

r-»oo \||a;||=r rP +L J r ^no V||_||_„ r p+L J 



lP+1- 



It follows from the Comparison Theorem of [16J that the steady-state mean of V 1 ^ 5 is 
finite, with the explicit bound n(V 1 ~ & ) < b/e. This implies that the pth moment of X 
is finite since 1 — 5 = p/(p + 1). □ 



The drift criterion (1131) was introduced in the analysis of general state-space Markov 
chains in [4]. Under this bound polynomial rates of convergence are obtained on the 
rate of convergence to steady state. Using different methods, polynomial bounds on 
the steady-state buffer lengths and polynomial rates of convergence were obtained in 
[3] for stochastic networks based on a general result of [21]. The proof is simplified 
considerably in this countable state space setting. 

To establish f[T3"j) we take V = V p with, 

\\x\\T 

N 



(15) V p (x)=e[J2\\X 

t=o 



x G 1i + , 



where T > 1 is a sufficiently large fixed integer. The growth bounds f|T4j) are suggested 
by the approximation, 



(16) J_v p (kx k )^e[J^ \\x K (t;x«)\\ p dt 

with x K defined as in (jSJ) via x K (t; x K ) := K 1 ~ 1 X(nt; nx K ) 



x G M+, k > 0, 



Proposition 3.3. The following hold under the assumptions of Theorem \3.'Bc for each 
p = 1,2,... the function V defined in ( 1151) satisfies the drift condition ( ITBT) and the 
bounds (Q3} with 5 = (1 +p)~ 1 . 
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To prove the proposition we first note that stability of the fluid model implies 
convergence in an L p sense. The proof of the almost sure limit in Proposition 13.41 
uses equicontinuity of {x K {t]x K ) : t > 0}, and the L p limit is obtained using the 
Dominated Converence Theorem since L is a bounded sequence. Recall that T and 
flo are introduced in the definition of stability for the fluid limit model. 

Proposition 3.4. Suppose that the fluid model is stable. Then it is uniformly stable 
in the following two senses, 

(i) Almost surely: For T > Tq and uj G VLq, 

lim sup \\x K (T; x K ,u)\\ = 0. 

||x||=l 



(ii) In the L p sense: For T > T , 

(17) lim sup E[\\x K (T;x K )\\ p } = 0. 

«-»"» 11x11=1 

□ 

Proof of Proposition \3.3[ Before proceeding it is helpful to review the Markov property: 
Suppose that C = C(X(0),X(1), . . .) is any random variable with finite mean. We 
always have, 

E X (n)[C] = E[ti n C | X(0),...,X(n)] = E[# n C | X(n)\, 
where T n := a{X(0), . . . , X(n)}, n > 0, and d n C denotes the random variable, 

$ n C = C(X(n),X(n + l),...) 

^ 1 1 fn'l 1 1 T 

We apply the Markov property with n = 1 and C = Y^t=o II^WII P - 111 this case we 
have, 

||X(1)||T 

t=i 

so that the Markov property gives, 

||X(1)[|T 

v p (x(i)) = e x(1) [c]=m[ \\x(tW\Fi. 

t=i 

Applying the transition matrix to V p gives PV p (x) = E X [V P (X(1))], so that 

|X(1)||T 



pv p (x) = e x [ \mw 



t=i 
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x e ill. 



The sum within the expectation on the right hand side is almost the same as used in 
the definition of V p . However, instead of summing from to T||X(0)||, we are summing 
from 1 to T||X(1)||. Consequently, writing y = X(l), we have the expression, 



PV p (x) 



V p (x) - ||x|| p + E. 



I|y||r 

t=||x||T+l 



X 



xez 



N 
+ ' 



where the sum is interpreted as negative when ||x|| > ||y||. Under the assumption that 
L is a bounded sequence we obtain the bound PV P < V p — \\x\\ p + b p , where b p is the 
supremum over x on the expectation on the right hand side of (11 8p . We now argue 
that b p < oo. Recall that under assumption (fTOj) the increments of X are bounded, 
|||a;||T — ||X(1)||T| < b$T. This combined with (TP71) implies that b p is indeed finite. 

To complete the proof we now establish (Tl4l) . For this we apply ( TT2l) . which implies 
that V p satisfies the pair of bounds, 



\\x\\T 



\\x\\T 



ii(^-M)+ir < Vp{x) < J2 \\x+bot\\ p , x e z;. 



t=0 



t=0 



This implies ( IT41) . 



□ 



4 Scheduling policy 

The remainder of the paper is devoted to establishing the main result, Theorem 
Throughout the remainder of the paper we restrict attention to the KSRS model (jHJ) in 
continuous time. The network is assumed symmetric with Ai = A3 = 1, /ii = /i 3 = 00, 
and fi 2 = A*4 finite. The traffic intensity of each server is denoted, 

pi := Xifii 1 + A 3 ^4 1 = p^ 1 
p 2 := Ai/i 2 1 + A 3 ^ 2 1 = p 2 1 

To prove Theorem 12.31 we construct a particular non-idling stationary policy. 

The proofs of Lemmas 14.11 and 14.21 are contained in the Appendix. Recall that the 
function \1/ is defined in Theorem 12.31 

Lemma 4.1. For each constant c > 1, the function \l/(cs)/\l/(s) is a strictly increasing 
function. Moreover, 



> m — 7 V 

— - .^{cm 7 !) 



4 

< 00, 



l<m<oo 



for any r] satisfying, 



log(c) 
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Throughout the remainder of the paper we fix p 2 , p4 so that the conditions specified 
in Lemma [4.21 are satisfied. 

Lemma 4.2. Define Pi = ^724 and p 2 = 4724 with, 

Pi Pi 

72 = 1 , 74 = 1 , 724 = 7274 , 7 = 74 + 724- 

1 - p 2 1 - Pi 

The 'parameters p 2 , p^ can be chosen so that p^ e (1/2, 1) /or z = 1, 2, (3 2 > Pi > 1, 
and the condition [W\) is satisfied with c = Pi and r\ = log(/3i)/log(/3 2 )- 

We define for s, n > 1, 

m*( s ) = (^(pis^)/^(s v ))^ 

(20) 

^(n) = **(n)/**(n + 1). 

By Lemma [4. 11 is a strictly increasing function, so ip(n) G (0, 1). The scheduling 
decisions are parametrized by ip = {ip(n)} and are made only at the sampling instances 
{ T n, n > 0} introduced in Section [3j 

The scheduling decisions for server 1 at time l~ n £11*6 defined as follows: 

(i) If only one of the two buffers at server 1 contain jobs (buffer 1 or buffer 4), the 
server works on the first job in the non-empty buffer. That is, the policy is 
non-idling. 

(ii) If both buffer 1 and buffer 4 are non-empty, and buffer 2 is also non-empty, 
then buffer 1 receives strict priority at server 1. Since pi = 00, all of the Qi(r n ) 
jobs are instantly sent to buffer 2. 

(iii) If both buffer 1 and buffer 4 are non-empty, and buffer 2 is empty then the 
scheduling decision depends on whether r n corresponds to an arrival into buffer 
1 or not. If it does not correspond to an arrival into buffer 1, then server 1 
works on the first job in buffer 4. 

(iv) The policy is randomized if both buffer 1 and buffer 4 are non-empty, buffer 2 
is empty, and r n corresponds to an arrival into buffer 1. In this case, with prob- 
ability ip(m) the server works on the first job in buffer 4, and with probability 
1 — if)(m) it works on the jobs in buffer 1. This choice is made independently 
from any other randomness in the network. In the second case, since the service 
rate is infinite, all of the jobs in buffer 1 are instantly sent to buffer 2. 

The scheduling decisions in server 2 are defined analogously. 

With a slight abuse of notation we denote this scheduling policy by ip. We denote 
by Q = (Q(0), p 2 , A*4j VO the queueing network together with the scheduling policy tp 
and the initial state Q(0). 

The conclusions of Proposition 14.31 are immediate from the discussion in Section |3J 
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Proposition 4.3. Under the scheduling policy ip the process Q and the embedded pro- 
cess {X(n) : = Q(T n )} are Markovian. The chain X satisfies the skip-free property ( jTUi) 
as well as the irreducibility condition (jTTj) . If X possesses an invariant measure tt then 
it is necessarily unique, and satisfies n(x*) > with, 

(21) x* := (0,0,0, 1) T . 

The following result is used to translate properties of invariant measures to the 
process level properties in the network. 

Proposition 4.4. Suppose the queueing network Q is such that an associated invariant 
measure tt exists, and 7r(\l/) is finite. Then for every constant 5 > 0. 

(22) limsup*(5s)P x *(K^ >5) < oo. 
Moreover, for every constant 5 > 

(23) limsup^(.5£g)P a .*(sup > < oo. 

s^oo t>s t 

Proof. By Proposition 14.31 we have ir(x*) > 0. Applying Markov's inequality gives, 

y(6s)F x *{\\Q{s)\\ > 5s) = ^(6s)F a ,(9(\\Q(s)\\) > *(<fs)) 

< E x *[*(\\Q(s) 

(*) 



< 7T 



= 7r- 1 (x*)E.[^(||Q(0)||)], 

where in (*) we simply use 1 = tt- 1 {x*)-k{x*) < ir-\x*) E 2/ 7r (?/)- Then & follows 
immediately. 

We now establish (|23|) . Fix 5 > and let 5 = 5/4. Consider any s > and let 
Sk = (1 + 5) h s, k > 0. We use the following obvious identity, 

\\Q(t)\\ \\Q(Sk)\\ A(Sk, Sfc+l) + A 3 (s fc , s fc+1 ) 



s k <t<s k+1 t Sk Sk 

with Ai(sk, Sk+i) denoting the arrivals to buffer % in the interval (s&, Sk+i]- Hence, 

P(sup M >5)<Y: P(" g(gfc) " > 5/2) + £ P( Al(Sfc ' Sfc+l)+A3(Sfc ' Sfc+l) > V2). 
* fc>0 Sfc fc>0 Sfc 

To complete the proof it suffices to show that 
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(24) lim sup %56s) ^ p(M^i > S /2) < oo, 

s^oo k>Q S k 



(25) 



lim sup W(.55s) 2^ ™( >o/&) < oo, 



St 

fc>0 K 



Applying (1221) . we have that 

IIGMII 



£p x ,(M^i > 5/2) = O^M^s*)]" 1 ) = o(]>>(.55(1 + h k s)V] 

k k 

= 0(^(.55(l+5) fc S )- losC55(1+ ^ s) ) 



Now for all s such that .55s > 1 we have 

v ^ -<v - 

, (.55(1 + 5)fc S )l°g(-5«5(l+5) fc S ) - (_5J s )log(.55(l+5)* S ) 



1 



E 



— ' (.55 s )l°g(-55s)+fclog(l+5) 

(.55s)- log( - 55s) ' 



1 - (.55s) -i°s(i+<5) 
1 



1 - (.55s)- lo s( 1+5 ) 

Since the limit of the second component of the product above is equal to unity, we 
obtain that (J23D holds. 

We now establish (125]) . Using the large deviations bound given by Lemma [A. II in 
the Appendix, we have 

F(Ax(s k , Sfc+i) > (5/2)s fc ) = P(Ai(sfc, Sfc+i) - (sfe+i - s k ) > (S/2)s k - (s k +i - s k )) 

< F(Ai(s k , s k+ x) - (s k+ i - s fe ) > (— - l)(s fc+1 - s k )) 

25 



We also have 



Li(s fc , Sfc+i) - (s fc+ i - s k ) > (sjfe+i - s fe )) 
< exp(-fi(sfe+i - Sfe)) 
<exp(-fi(5(l + 5) fc s)) 



J]exp(-fi(5(l + 5) fc s)) < exp(-Q(s)). 

fc>0 



Since \& grows slower than exponentially we conclude that (|25|) holds. □ 
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5 Stability of the fluid limit model 



The goal of this section is to establish stability of the fluid limit model obtained from 
the scheduling policy ip. Specifically, we establish the following result which is Part 2 
of Theorem 12.31 

Theorem 5.1. There exists a constant cq > such that for every e > 

hm sup F x I — 1| > e I =0. 

»oo ' 11*^11 

Proof. The result is obtained by combining Proposition l5.3l with Lemma 15741 that follow. 

□ 

The proofs in this section rely on regeneration arguments, based on the stopping 
times defining the first emptying times for the four buffers in the network, 
(26) 

Ti = inf{f >Q:Qi{t) = 0} 7* = m£{t > : Qj(t) = for all j ^ i, i = 1, . . . , 4}. 

The following feature of the model is crucial to obtain regenerative behavior: Although 
the policy is not a priority policy, its behavior at buffers 4 and 2 is similar. For example, 
since the policy is non-idling and the service rate at buffer 1 is infinite we can conclude 
that buffer 4 receives full capacity while this buffer is non-empty. 

Lemma E2] follows from these observations, and the specification of the policy that 
gives priority to jobs in buffer 3 while buffer 4 is non-empty. 

Lemma 5.2. Under the policy ip with Qa(0) > 1, the contents of buffer 4 evolves as 
an M/M/l queueing system with arrival rate 1 and service rate fi^, until the first time 
Q4 becomes zero. 

Proposition 15.31 concerns the special case in which all the jobs are initially in 
buffer 4. 

Proposition 5.3. Let x n = (0,0, 0,n) = nx* and r = l/(/i4 — 1). For every e > 

limP a .«(j|Q(Tn)|| < en) = 1. 

Proof. We begin with an application of Lemma 15721 to conclude that Q±{t) corresponds 
with an M/M/l queueing system up to time T 4 . Applying Lemma [A. 2 1 we obtain for 
every e > 

(27) limP x .n (JT 4 < en) = I. 

We now analyze the queue-length processes in buffers 1 and 2 during [0, T4). For 
each k > 1, with probability (1 — ip(k)) Yli<i<k-i "^Wj priority is given to jobs in 
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buffer 4 up until the time of the k-th arrival. At this time the k jobs at buffer 1 are 
immediately transferee! to buffer 2. While buffer 2 is non-empty, full priority is given 
to jobs in buffer 1 over jobs in buffer 4, so that any new arrivals are sent to buffer 2 
instantaneously. At the first instance t 2 (1) < T 4 that the buffer 2 empties (assuming 
one exists), this process repeats. 

Hence the policy tp induces the following behavior: there is an alternating sequence 
Ri, L\, R2, L2, ■ ■ ., where Ri corresponds to time- intervals before T4 when buffer 2 is 
empty, and Li corresponds to time-intervals before T4 when buffer 2 is non-empty. The 
sequences Ri,l > 1 and L\ > I are i.i.d., and the length of Ri is independent from 
Ri 1 , Lit, I < I — 1. 

Let 77 = J2j<i(Rj + Lj). The queue length in buffer 1 at the end of the time 
period corresponding to Ri (that is at time 7i_i + Ri) is equal to k with probability 
(1— ip{k)) rii<j<fc-i ^(0- Let Xi represent this queue length Q\{t) at time t = T1-1+R1. 
We have 



Applying the second part of Lemma I4~T| this sum is finite, namely Xi has a finite second 
moment. Then Ri has finite second moment as well since, conditioned on Xi = k, it is 
a sum of k i.i.d. random variables with Exp(A) distribution. Conditioning on X\ = k, 
the length of Li represents the time to empty an M/M/l queueing system with k initial 
jobs, arrival rate 1, and service rate /i2- Hence E[L^|A; = k] = 0(k 2 ) by Lemma [A. 2 [ 
Since X[ has a finite second moment, so does L;. We conclude that 77 — Tj_i = Ri + Li 
has a finite second moment. 

Assume now that T4 = 00 by placing infinitely many jobs in buffer 4. Given any 
positive t > 0, let l*(t) be the unique index such that t 6 [ri*(t)-i,Ti*(t)]- Applying 
Smith's Theorem for regenerative processes (see Theorem 3.7.1. in Resnick pZTJ), for 
every m > 



E[xf} = ^k 2 (i-m) n 



fc>l Ki<fc-1 



<5> 2 n iko 



fc>i i<i<fe-i 




lim P(Qi(t) +Q 2 (t) > m) 



HJo 1 HQijt) + Q 2 (t) > m}dt] 
E[rJ 



where ri = i?i + L\. Applying the Cauchy-Schwartz inequality we obtain, 
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E[ / l{Qi(t) + Q 2 (t) > m}dt < E[l{ sup Qi(t) + Q 2 (t) > 

0<t<Tl 



< /P( sup Qi(t) + Q 2 (*) > m)E[r 1 2 ] 

0<t<Tl 



< 



^(^(n) >m)E[r 1 2 ], 



Observe that A\(t\) — X\ + A(i?i,Ti). Conditioning on X 4 = and applying 
Lemma [A. 21 gives E[A(i2i,Ti)] = 0(k), and since the mean of Xi is finite, E[X 4 ] < oo, 
we obtain E[yl 1 (r 1 )] < oo. 

Markov's inequality, gives the bound P(t4 1 (t 1 ) > m) = 0(l/m), and since Epr 2 ] < 
oo we conclude, 

lim P a ,«(Qi(t) + Q 2 (t) > m) = O(-). 

t^oo m 

Now we recall ([27)1 and use independence of interarrival and service times to conclude 
that 

limP-^Qi^) + g 2 (T 4 ) > m) = O(-). 
n m 

Since Q3(T 4 ) + Q 4 (T 4 ) = 0, we obtain an apparently weaker result that for every e > 

limP^n ( || Q(T 4 ) || < en) = 1. 



It remains to relate ||Q(T 4 )|| to ||Q("^zi)||- We use the fact that the difference between 
||(3(-^zj)|| and ||Q(T 4 )|| is at most the total number of arrivals and departures during 
the time interval between j^zi an d T±. Using the large deviations bound Lemma [A. II 
applied to arrival processes to buffers 1 and 3 and service processes in buffers 2 and 4, 
and combining with (T2T1) . we obtain 

UmF x u(\\Q( -) <en) = 1. 



□ 



We now assume that x is not of the form (0,0, 0,n) and complete the proof of 
Theorem 15.11 by establishing the following lemma. 

Recall that {Tj} are defined in (|26|) . given Q(0) = x. We let T denote the minimum, 

T = min(T2,T 4 ). 

Lemma 5.4. For some constants Ci,c 2 > ; 

liminf F X (T < Cl \\x\\ and \\Q{T)\\ < c 2 \\x\\) = 1. 
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Proof. To obtain bounds on the probability in the lemma we claim it is enough to 
consider the special case in which one of the servers has no jobs at time t = 0. 

Suppose both of the servers are initially non-empty, let x = Q(0), and consider 
the following cases. If Q 4 (0) = then this violates the right-continuity assumption 
since we then have Qi(0) > 0, and all of the jobs in buffer 1 proceed immediately to 
buffer 2. In the second case Q 4 (0) > 0, and we can apply Lemma [5.21 to deduce that 
T±(x) = 0(|| x ||) with probability approaching unity for large ||x||. At time T 4 buffer 3 
is empty and all of the jobs in buffer 1 immediately proceed to buffer 2. Once again 
we arrive at a state Q(T±) corresponding to an empty server. 

In the remainder of the proof we assume that one server is empty at time t = 0; 
Without loss of generality this is server 2, so that x 2 + £3 = 0. Again, if in addition 
X4 = then only buffer 1 is non-empty, and all the jobs in buffer 1 are sent to buffer 2, 
giving T = 0. 

Otherwise, suppose that x% +X3 = 0, x 4 > 0, and consider the queue length process 
at buffer 4. Applying Lemma 15.21 we conclude that buffer 4 evolves as an M/M/l 
queueing system, and Lemma [A. 21 implies that the emptying time T 4 for buffer 4 is less 
than Ci||x||, with probability approaching unity as n — > 00, for some constant c\. At 
t — T4 buffer 3 is empty as well and all the jobs in buffer 1 (if any) instantly proceed 
to buffer 2. Hence buffers 1,3 and 4 are all empty at time T 4 , so that T = T 4 . 

This gives a uniform bound on the probability f x (T < ci||s||) for initial conditions 
corresponding to one empty server. To obtain a uniform bound on F X ({T < ci||a;||} D 
{||Q(T)|| < C2||x||}) for some C2 we apply the large deviations bound of Lemma [A. II to 
the arrival processes along with the bound ||Q(t)|| < \\x\\ + \\A(t)\\. □ 



6 Lower bounds on the tail probability 

The goal of this section is to prove Part 3 of Theorem 12.31 In light of Theorem 13.11 it 
suffices to establish Qj, and then the lack of exponential ergodicity will follow. 

Recall the definition of the first emptying time T 4 from (1261) . We fix a constant 
e > 0, and define the following events given Q(0) = x, 

£ 4 = l( (1 - e)X4 <T 4 < (1 + e)X4 



/x 4 - 1 /i 4 

:i - e)2x4 <g 2 m)<il± e) ^ 

[A4 — 1 yU 4 

Like Lemma [53, the following result compares an emptying time for the stochastic 
model with the emptying time for a fluid model. 



£1 = ^ < Q 2 (T 4 ) < Ii±^l A Q 4 (T 4 ) = 0, ,V 2). 

I LLa — 1 LLa — 1 ) 



Lemma 6.1. Consider a non-zero initial state ) satisfying Xi = 0,i 7^ 

4. Then for any < e < 1/10 

(28) F x (£ 4 n £1) > 0((^*(2 74 x 4 ))- 1 ). 
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Proof. Consider first a modified scheduling policy if) that always gives priority to jobs 
in buffer 4 in server 1 and buffer 3 in server 2. For the policy if) we let {Tj} denote the 
draining times for the four buffers. For this policy all jobs in buffer 3 are transfered to 
buffer 4 instantaneously so that buffer 4 operates as an M/M/l queueing system for 
allt > 0. Applying the bound (|39l) from Lemma lA.21 the stopping time T 4 satisfies, 

(29) Pf (1 - £) f 4 < T 4 < (1 + £) * 4 ) > 1 - exp(-nW). 

V yU 4 — 1 yU 4 — 1 / 

Let mi(x) denote the number of arrivals to buffer 1 before buffer 4 becomes empty for 
if>. That is, 

7711 (x) = Ai(T 4 ). 

Using Lemma [A. II applied to the arrival process, combined with (1291) . we obtain 

/ \ — e) 2 x 4 . . (l + e) 2 x 4 \ . ^. 

30 P(i —<frni<- V^J > l-exp(-fi(ar 4 )). 

V // 4 — 1 /i 4 — 1 / 

Now we return to the original scheduling policy if). For every m, conditioned on 
mi (x) — m i the probability that at every arrival instance the priority was given to jobs 
in buffer 4 is rii<i<m^W = i^* (m))' 1 . If it is indeed the case that at every arrival 
into buffer 1 the priority was given to buffer 4 for all arrivals up to the m\ (x)-th, then 
T 4 = T 4 and Qi(T 4 ) = m\{x). If in addition m = m\{x) satisfies the bound 

(1 + e) 2 x 4 (l + e) 2 pix 4 

777 < — = < 27 4 X 4 , 

H4, ~ 1 1 - pi 

then, by monotonicity of we have (\l/*(m)) _1 > (^/*(27 4 x 4 )) _1 . If during the time 
interval [0,T 4 ] server 1 is processing only jobs in buffer 4, then at time T 4 server 2 is 
empty Since at time T 4 buffer 4 also becomes empty, all the Qi(T 4 ) jobs in buffer 1 
instantly arrive into buffer 2 at time T 4 , and all the other buffers become empty at T 4 . 
That is Qj(T 4 ) = 0, i ^ 2 and (52(^4) = rni(x). These arguments combined with fl29l 
and fl3"U|) give, 

P^Dfi) = (^(2 74 a; 4 ))- 1 -2exp(-fi(a; 4 )) = 6((^(2 74 x 4 ))- 1 ), 

where the last equality follows from subexponential decay of This completes the 
proof. □ 

Define the stopping time, 
(31) T 24 = inf{t > T 4 : Q 2 (t) = 0}, 

and for a given x = Q(0) consider the events, 
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(/i 4 - l)(/i 2 - 1) * {jJ>4 - 1)(A*2 - 1) - 1 ' 

Lemma 6.2. Consider a starting state ) satisfying x t = 0,i ^ 4. 

TTien /or every e > 

(32) ¥ x (£ 42 n £ 13 n £ 4 n = e(($*(4 724 :r 4 ))- 2 ). 

Proof. The event £1 is equivalent to {Q(T 4 ) = (0, z, 0, 0) for some z £ 5 4 }, where <S 4 is 
the set of integers, 

(l-e) 2 ^4 (l + e) 2 x 4l 

/i 4 — 1 /i 4 — 1 

Consequently, 

f(^ 42 n £ 13 ns 4 n£ 1 ^) = J2 p (^ 2 n £ i3 n (Q(r 4 ) = (o, *, o, o)) n £ 4 ) 

zG54 

= ^p(£ 42 n£ 13 |Q(T 4 ) = (o,z,o,o))p(q(t 4 ) = (0,z,0,0)n£ 4 

where in the second equality we use the Markovian property of the scheduling policy 
ip. Applying Lemma 16.11 but interchanging buffer 4 with buffer 2 and buffer 3 with 
buffer 1, we obtain for every z. 

P(£ 42 n£ 13 |Q(T 4 ) = (0,^,0,0)) > e((^(2 72 ^))- 1 ). 

For every z £ «S 4 , given the bound e < 1/10, we have z < 2 74 x 4 . By monotonicity of 
\I>* and the definition 724 = 7 2 7 4 we obtain [^f*(2j 2 z)]~ 1 > [\l/*(4 7 2 4 x 4 )] _1 . 
Finally, we note that, 

^p({Q(T 4 ) = (o,z,o,o)}n£ 4 ) =p(^n^ 4 ) 

2€54 

which is at least 0((\l / *(2 74 x 4 )) _1 ) by Lemma \6. 11 Now p 2 > 1/2 implies 72 > 1 which 
gives 724 = 7274 > 74. Combining these bounds we obtain the desired bound (|32|) . □ 

Lemma 6.3. Given a state x such that x; t = 0,i 7^ 4, there exists a random time T 
such that, 

p(^<T<2 7 * 4 A f<^< 2 ~f A Q 4 (T) = 0,^4) 

> e((vr(4 724 x 4 )r 2 ). 
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Proof. The event £4 fl £42 implies 

((1 - e) 7 4 + (1 - e) 3 724)x 4 < T 24 < ((1 + e) 74 + (1 + e) 3 724)x 4 , 
the event £13 implies 

(l_ e )4 724 <Q 4 ( T24 ) < (l +e )4 ;724 



and the bound e < 1/10 implies that 1/2 < ^ + ^| 4 < < 2. The result is obtained 

from Lemma 16.21 and using 7 : = 74 + 724. □ 

We now use Lemma 16.31 is used to obtain the following bound. 

Proposition 6.4. There exist constants < a < 1, 5 > stzc/i t/iat /or ever?/ n e Z + 



(33) p x * sup^^><5 >«" rr (^*(/? 2 m+i ))- 2 . 



Km<n 



Proof. For every n > 1 denote by S n the event that the event described in Lemma 16.31 
occurs n times in succession starting from the state x = x* . For each m let a m is the 
length of the time interval corresponding to the m-th event, and let S n = Ylm=i cr »«- 
The random time S n is only defined on the event S n . 

Using Lemma [6T3l the event £ n implies that ^ < 07 < 27, and for each 2 < m < n, 

j<m—l j<m—l 

(34) 

724 , n f sr^ \ . 2 7 24 

— cr m < g 4 ( } o-j) < 

27 ^ 7 

j<m 



in ■ 



Combining, we obtain 

724 

' 42 " n " z - - 4r. 



/o^ ^ 724^ . 7^ ^ ^ 724 1 ^ 724 1 7 

(35) a n > — cr„_i > -— -cr n _ 2 > ■ ■ > -o\ > - — . 

V / n — . n 1 — . 2 n z — — An-l 1 — An— 1 O ' 



and 

(36) a n < 4 724 o- n _ 1 < (4 724 ) V n _ 2 < • • • < (4 7 2 4 ) n "V 1 < (4 724 ) n - 1 2 7 , 
The chain of inequalities (|35|) implies in particular that 

(37) S n >a n > Jgl. 

Since /3i = 72 4 /4 > 1 by Lemma [4.21 the same chain of inequalities implies 
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(n—m) co —j 

(38) S „ = ^, m < a „^|4_< (7 „j : ^ = _^ 

m 

Also the event S n implies 



4_ ■ 

m<n ~ j=l ~ " 724 



Then from fl38l) we obtain 



\\Q(Sn)\\ > ^ 
On ~ 27' 



27 724 

Recalling the bound (l3"Tj) . we conclude that the event £ n implies 

suprlQWII : t > 1(51)-'} > MM > _ ±). 

2 4 5 n 27 724 

We have /3i = 724/4 < 7/2 and conclude that the event £ n implies 

sup M >j:= * (1 _i). 

t>/5% * 27 724 

It remains to obtain the required lower bound on P^* [S n ] . We first obtain a bound on 
'$ > x*[£m\£m-i],n r i> = 2,3, ...,n. For convenience we set £q = 1{Q(0) = x*}. For each 
1 < in < n the event £ m -i via (1361) and ([3lj) implies 



Qa( V oj) < -a m < -(4 724 ) m - 1 27 = 4 m 7 2 T 1 - 

j<m-l 1 ' 

Let a > be a constant hidden in the G(-) notation in Lemma 16.31 Then, from 
Lemma [6.31 we obtain 

P x ^m\£ m -i} > a(vl/*((47 24 )4 m 72 m 4- 1 ))" 2 > a(vT ((4 7 24) m+1 )r 2 . 
Since this holds for every n > m > 1 and S± D S2 D ■ ■ ■ D S n we obtain 

¥ x .[e n ]>a n J] (^*((4 724 ) m+1 ))- 



Km<n 



This concludes the proof of the proposition by substituting fi 2 for 4724. □ 
We are ready to conclude the proof of the final part of Theorem 12. 3[ 
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Proof of Part 3 of Theorem \2.3i Using the expression ( 120|) for \J r * we have 



l<m<n 



^From Proposition 16.41 we obtain that for all n 



su P mi > s 



> 1. 



Using Pi = s and finding a constant 772 > such that (1/a) = P^ 2 , we obtain 

IIQWII 



liminf s r]2 ^(Pfs)F x 



sup , 

L t>s t 



> S 



> 1. 



Now 



s'&tf^s) = S ^^2 s ).51og(/3?s) =eX p(.51 g2 s + 2 log/5 1 logS + 21og 2 /5 1 logs). 

Observe, that the righ-hand side, as a function of s is 

o(e log2 (- 55s) ) = o(tt(.5<5s)) 

since the leading term in the first term is e 51og2s and in the second term is e log2s . We 
conclude 



liminf V(.55s)F x . 



sup 

t>s t 



> 5 



00. 



Applying the second part of Proposition 14.41 we obtain (Q. The proof of Theorem 12.31 
is complete. □ 



A Appendix 



In this section we provide proofs of some of the elementary results we have used above. 
Some of the results are well known. 



Proof of Lemma 4jJ_ We have 



(cs 



.log(cs) 



j log 



c log(cs) s logc 
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which is a strictly increasing function for every c > 1. Now suppose 77 > is such that 
(1151) is satisfied. Then 



\ 2 m3 r?logm ' 7 



m 



l<m<oo v ' \<m<oo V w,( 7 



2.^1 Irr 



2 

m 



l<m<oo 

1^,2 



C 4'/ 2 log c™ m \v 2 logc' 



The condition (1T91) implies jt] 2 logc — 2 > 1, which implies the result. 

□ 



Proof of Lemma \JJ§ We fix a small 5 > and let /x 2 = A*4 = 1 + 5. Then p 2 = Pi 



1/(1 + 5), 72 = 74 = 1/5,724 = l/5 2 ,& = 4/5 2 , ft = 1/(4^,77 = g$ffit ,c = ft 
l/(4<5 2 ). Then 



^logc = f 10g(1/ ' 2)+4 Vlog(^) 
^ g Vlog(l/5 2 )-4y gl 45 2j - 

As 5— > 0, 77 — > 1, c — > 00 and the condition (1T91) is satisfied for sufficiently small 5 > 0. 
All the other constraints are satisfied trivially. 

□ 

We use in this paper very crude large deviations type bounds. Of course in most 
cases far more refined large deviations estimates are available [19], but those are not 
required for our purposes. 

Lemma A.l. Let N(t) be a Poisson process with parameter v > 0. Then for every 
constant e > 

P(|iV(t) - vt\ > et) = exp(-n(t)). 

Here the constants hidden in Q include e. 

Lemma A. 2. Consider an M/M/l queueing system with parameters A, //, p = A//i < 1. 
Let Q(t) denote the queue length at time t and let T = inf{£ : Q(t) = 0}. Then 
E[T\Q(0) =n] = 0{n) and E[T 2 \Q(0) = n] = 0{n 2 ). Moreover 

(39) P(_J__ G (1 — e, 1 + e)) = 1 — exp(-fi(n)). 

Proof. These are well known results from queueing theory. One quick way to establish 
them is to observe that T = Xa<j<n^j> wriere Tj is the first passage time from j 
to j — 1. That is Tj = inf{£ : Q(tj = j — 1\Q(0) = j}. The sequence Tj is i.i.d. 
with the distribution equal to the distribution of the busy period, which is known 
to satisfy E[exp(sTj)] < 00 for some s > 0, and has the first moment l/(/i(l — p)). 
We immediately obtain E[T|Q(0) = n) = n/(p(l - p)) and E[T 2 |Q(0) = n) = 0(n 2 ) 
(actual value is easy to compute but is not required for our purposes). Applying large 
deviations bound [19] to the i.i.d. sequence Tj we obtain ( 1391) . □ 
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